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ABSTRACT 

This is a summary report on the development and 
implementation of the Child Development Associate Consortium's 
Credential Award System (CAS) . The CAS has as its purpose the 
assessment of the performance of child care workers and the granting 
of Child Development Associate (CDA) credentials to those who 
demonstrate competence in caring for children. During the development 
stage of the CAS two field studies were conducted: (1) the 1974 field 
study, which was intended to test the feasibility of assessing 
candidates using the Consortium's assessment model, to plan research 
and coordinate assessment with the creden tialing system, and to 
conduct formulative research on the prototype assessment system; and 
(2) the 1975 field study, which provided information about how well 
the revised assessment process worked in the field. Following these 
studies a decision was made to implement the CA3^ and a third study 
was conducted to evaluate the first year of implementation (1975-76). 
The evaluation study and both field studies are described in detail 
in this report. Included also is information about the development of 
the CDA Consortium and the six steps in the credential award system. 
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POEEKARD 



This is a sumnaxy report on the develofrnent and 
inplenentation of the Child Development Associate Con- 
sortiim's Credential Award System. It has been developed 
for the Septonber 1976 CDA irTonbership meeting. Contents 
of this report have been taken fron a more coiprehensive 
orgairLzational development report vfcLch is currently in 
press. 

Informtion about the development of the CDA averd 
systan and the evaluation of the first year of operation 
are included in the report. Evalioation data v?ere g:.thered 
by an independent market research f inn. Interviewing was 
conducted between July 26 and August 2, 1976 , via centrally 
located telephone W£IS lines under the direct si:pervision 
of the research fim's personnel. A total of 201 inter- 
views were corpleted — 51 vdth CDA representatives and 50 
with each of the remaining roles on the lAT; (credentialed) 
candida t es y trainers , and parent-caimunity representatives. 

The questionnaire produced over 220 variables for 
each category of team member. Data were subjected to des- 
scriptive and inferential statistical analyses. A variety 
of treatments, including multivarietie analysis, were 
performed to help describe the LAT msnbers' response. In 
addi tion, validity of the Award systan was investigated, 
using factor analysis. 

Highlights from the early development of the consor- 
tium are included in the first section, followed by the 
1974 and 1975 Field Study results. The last section 
provides selected information about the four objectives 
which were used to evaluate the first year's operation. 
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EXECUTIVE SUMMZ\Ry 



IOTRDDUCTI(»I 



This is a sumnary report about the developnent 
ard irrplementation of the Child Developnent Associate 
(CDA) Consortium's Credential Award Systen (CAS). 
The CAS is the means by which the Consortium carries 
out its basic purpose: to assess the perfonnance 
of child-care workers and to grant credentials to 
those who doncnstrate corpetence. 

THE CPA CONSORTIUM 

The Child Development Associate Consortium is a 
pri\'ate, nonprofit corporation corposed of 39 national 
groups and two public manbers, tte total representing 
a monbership of more than half a million persons vto 
are directly concerned with the education and develc^ 
ment of young children. 

A CHUD DEVELOPMENT ASSOCIATE 

A Child Develcpnent Associate (CDA) is a person 
who has earned a new kind of credential in early 
childhood education/child developnfient. The CDA cre- 
dential signifies that its holder has been assessed 
and found to be corpetent in helping children learn 
and develop. Having the CDA credential means that a 
person is recognized nationally for his or her com- 
petence in caring for children; this recognition is 
given by the early childhood education/child devel- 
cpnent profession as this is represented in the CDA 
Consortium. 



cm CCNSORTIUM'S CREDENTIAL imBD SYSTEM 



The Consortiiim processes applicants for the CDA 
credential by means of the Crec3ential Award System 
(CAS) . ^ The CAS provides for all necessary contacts, 
caTinunications, evaluations and activities required 
of a person seeking the CDA credential. 

The CAS has six phases: 



1. 
2. 
3. 
4. 
5. 
6. 



Pre-Entry Process; 

Intake and Initial Assessinent Activity; 
Candidate Readiness; 
Team Assessment; 
Award; 

Post Award Activity. 



The Credential Award Syston provides a candiate 
for the Child Development Associate credential with 
an individualized, self -paced, performance-based 
assessment of his or her corpetence in caring for 
young children. The assessment is condiicted by a 
team of persons, known as the Local Assessment 
Team (LAT) . 

CHUC DEVELOPMENT ASSOCIATE CONSORTTOM DEVELOPMENT 

The period fron June 22, 1972, to March 27, 1975, 
was oTr.: of intense activity, growth, and development 
for the Child Development Associate Consortium, as 
the record shows. In 31 months, the Consortim pro- 
gressed through incorporation as an organization to an 
operational credentialing agency. This was accom- 
plished prinerily through the developnent of the 
Credential Award Syston. In this period the: 

• ^ Board of Directors met eighteen times and 
established the organization and set consortium policy; 
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• Ctonscartium Staff developed and implanented 
the Credential Award System; 



• Consortium sponsored eleven task forces and 
colloquy groups which met 18 times ard provided 
direction,, guidance, information about the CDAC's CDA 
system. 

• Consortium subcontracted work to 44 groups 
for the development and refinement of corpetency 
statements, assessment instrumentation and creden- 
tialing procedures. 

• Consortium conducted two field studies of 
the assessment system and as a result in J^ferch 1975 
decided to iirplement the CDAC Credential Award System 

SIX PHASES OF THE CREDBJ^EAL AvvARD SYSTEM 

There are six phases of the Cr dential Award 
System which are used to determine candidate com- 
petency. Six ccmpetQicies and 13 functional areas 
are used in the system. A description of the phases, 
related canpetencies and functional areas, along with 
other information about the system- appears in 
Appendix A. 
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FIELD STUDY 1974 



INTRODUCTICN 



The Spring 1974 field test v;as conducted to 
evaluate the Child Develc^inent Associate Consortium 
Assessment model in actual field corxiitions. 

OBJECTIVES OF THE 1974 FIELD TEST 

The Spring 1974 field test of the Child Devel- 
cpnent Associate Consortim prototype assessment 
system was conducted between March' 1 aid J\jne 30^ 
1974. The Consortim wanted to study tha model on 
a national basis and determine its acceptance in 
the field. There were three objectives of the field 
test: 

• To test the feasibility of assessing cardi- 
dates using the Consortium's Assesanent Model, 

• To plan research and coordinate assessment 
with the credentialing system. 

• Tb conduct fanrailative research on the 
prototype assesstnent system. 

SAMPLE 

CDA pilot training. Head Start Si^iplementary 
Training, day care training/ and other programs 
vAiich provide vrorkers in early childhood were among 
the programs from which a sample was drawn. 
hundred forty-twD candidates were contacted and asked 
to participate. A total of 188 agreed ax^ 169 can- 
pleted the assesanent. 
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HIGHLIGHrs OF THE FINDINGS 



Results of the field test for highlight presen- 
tation have been grouped into three categories: 
general findings, LAT meetings and members roles, 
and the portfolio* 

General Findings 

An objective of the field test was to determine 

the feasibility of iirplonenting the assessment system. t ni> 

It vas determined that the syston could be implonented. ^^P<-^^Pt:^Ci^ 
Other findings were: 

• Role of Consortium Representative: Candidates 
vere assigned at randan to representatives 
whose roles were Ac±ive or Limited > The role 
had ^parently little impact "on the decision, 
or on candidate drop-^t rate. 

• Type of Program: Candidates were selected 
from four types of training programs: CDA 
pilot, HSST, day care, and otl^. The CDA 
programs had the highest percentage of can- 
didates judged corpetent and the lowest 
drop-out rates. Hbwever, the dropouts 
were, removed, the percentage of candidates 
judged cor^etent in all program types vas 
about the sane. 

• Itegional Differences: Fifty-five percent 
j^^^ of the sanpled candidates were located in 

one region. There was a greater percentage 

of candidates judged incorpetent in this 

region which was caused by tte high drcp-out 
f^f^^ rate. When dropouts were ronoved, the per- 

centage of candidates judged catpetent were 
Q/^ about the same. 

o 

/-^^ 
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Consortion Representative 

It vas determined that the Consortium Represen- 
tative was: 

• the most iinportant team member 

• instrumental to the pranotion of group process 

• generally successful with the groups; however 
there were problems with the group tasks and 
they didn't focus the process. 

Trainer 

Performance of the trainers varied with both 
successful and unsuccessful groi^ participation in 
the process. 

Candidate 

The results about the candidate showed that: 

• 85 percent felt that caniidate should be on Candi(h;tz^ 4^ 
the team; ^^^^ 

• 90 percent believed that the candidate should 
vote on his own recormendation; 

• A majority thought the team should vote in 
the presence of the candidates; and 

• Team monbers approved of permitting the 
ca n didates to select their own team members. 

Child Advocate 

The role of the Child Advocate was the most 
uTOublesone in the field test. 
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The problems identified with being a Child Aivo- 
cate were that the role required being: both a manber 
of the caniiunity and one who defended the rights and Vanovxt^ k 

welfare of children; able to under starxi the tasks Kogo 
and materials relating to early childhood and able to 
identify with group members as a peer. The results 
shewed that the range of C3iild Advocates' profession- 
al experiences varied fron trained professionals with 
advanced degrees to camunity meoibers without high 
school diplomas. Language used in the assessment 
tended to be too difficult and technical. Finally^ 
the lack of educational background prrxiuced team 
relationship rejection. 

Portfolio 

The purposes of the analyses were: to explore 
how the materials in the Portfolios were used to doc- 
ument the candidate's performance; to determine the 
best methods for demonstrating corpetence; and to 
determine if the methods differed as a function of 
research conditions. 

Results were: 

• The teams tended to produce fewer unsubstan- 
tiated Portfolios when the Representative 
was active. 

• Observational data on a candidate's actual 
performance provided the most solid picture 
of catpetence. Visual data, as a whole, did 
not supiJULL the judgments. Audio recordings 
had little value since candidates did not 
include written introdixrtions, nor did they 
describe hew taped sessions dononstrated a 
particular ootpetency. Photographs found 

in Portfolios tended to provide little 
support. 
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Sane Portfolios were essentadLUy incxniplete. 
One-fourth examined contained no Profiles^ 
or no information on the Profiles* 

The study produced sane well-documented 
Portfolios which contained unambiguous 
evidence of a candidate's carpetence. Thus, 
the Portfolio was a worJcable concept — but 
guidelines for caapleting Portfolios must 
be explicitly stated. 
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FTKTD STUDY 1975 



INTRCXXJCTICN 



The 1975 field test vas cx^nducted at the request 
of the Consortiijm's Board of Directors • The Board 
directed that the coiplete assessment syston be test- 
ed on a national saiiple of potential CDA Carxiidates. 
The Board wanted to get a preliminacy analysis of tte 
field-test data before deciding wheti^ or not to 
begin to assess Candidates and award CDA credentials. 

PURPOSE 

The purpose of the field test was to provide tte 
Cbnsortium with information about how well tte revised 
assessment process performed in tte field. Tte method 
was to select 100 potential CDA Cardidates, expose 
them to a ocmplete assesatient, and describe viiat 
happened. In this sense, tte study was more a process 
of eval u ation than systanatic field research. 

CBJECTIVES 

Tte 1975 field study was designed to evalualia 
tte Consortium's assessment syston prior to full int- 
plonentation with prospective cax^idates. Preliirt- 
inary results of tte field study were first presented 
to tte CDA Board of Directors in March 1975. MJi- 
tional questions posed at the March meeting broadened 
tte scope of tte evaluation. Tte followii^ objectives r 
ttierefore, go beyond tte original design of tte I975 
field test and include related data gathered and 
analyzed to help improve and descrite CDA's assess- 
ment systsn. 
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Three objectives and seven questions were used to 
structure tJoa results of the 1975 field test. Tte 
objectives were: 



• To detennine if the CDAC Assesanent Systen 
was ready to be used for credeHitialing cardidates* 

• To investigate the validity of ttie CDAC 
organizing schana, 

• To obtain follcw-up infonnation fron parti- 
cipants about how well the CDAC assessment systau 
worked in the 1975 field study. 



METHOD AISD PROCEDUKE 

Description of the Assessment Process as Tested 

Consistent with the request of tlie Consortium's 
Board of Directors^ the assesanent process as tested 
included all elements needed for a fully operational 
assesanent process. 

In the field test^ assesanent was corducted by 
a team of persons called a Local Assessment Team 
(lAT) . The team was structured to bring different 
points of view to the assessment; the LAT viewed 
the Candidate's perfonnance from the perspective of 
a Trainer^ that of a member of the caitnunity the 
Candidate serves^ that of the Consartium, ani that 
of the Candidate. 

Assesannent was performance-based. This means 
that the team evaluated, the Candidate's performance 
with children y staff and parents. Performance ^ 
rather than coursework and credits, was involved in 
the assessment. 
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SAMPLE 



The study onployed 91 Carv3idates selected at 
randan fran the 534 traiiiees registered ijci the thir- 
teen Child Developtient Associate National Pilot 
■n^ining Projects. Candidates were selected at randan 
in order to obtain a representative sanple. 

The sample included: 31% white, 24% black, 
12% Chicano, 9% Puerto Rican, 13% first Americans 
and 11% Asian itoiericans and Pacific Islanders • 



HICaL IQnS OF THE FINDIM3S 

There wero ::.;iiree objectives, seven questions 
and eight evaluiicion assurrptions used to analyze 
the results of tte 1975 field test. 



Objective one : To detennine if the CDAC assessnent 
syston was ready to be used for credentialii^ can- 
didates. 

CJuesticn: Is the assessment process vorlcable? 

The responses indicated that LftT manbers per- 
ceived that they followed the six steps. Manbers 
of the team reported foUaving the process eighty- 
twD to one hundred percent of the tiitie. 

The evaluation assurrptions that the lAT raembers 
followed the process and there was a sense of peer- 
ship among the LAT menibers was supported. 
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Qaestion two: Is the prcxress credible? 



LKP inanbers wsare asked to rate how certain they 
were regarding their jijdgrrents aboiit the candidate. 

Eighty percent of team inembers irxiicated that 
they were either "certain" or "reasonably siore" of 
their judgments. 

When the LAT manbers were asked to iniicate 
whetiier each would trust their own child to the care 
of the c^ndicJate, eighty-five percent of the team 
members responded that they would, 

The evaluation assurrption that the team members 
were certain about their judgment of the candidate's 
perfarmance vas supported. 

Results ; Local Assessnent Teams v^e asked to review 
eacn candi d ate's performance in 13 Functional Areas, 
and then to make an overall judgment. LM? members 
were asked to indicate how certain they v;ere of their 
judgments. The analysis was designed to determine 
whether, at one extreme, there was a single dimension 
of judgment or, at the other,.. 13 separate dimensions* 
In short, did team menbers look at each Functional 
Area frcm a global point of vie^v; from a specific point 
of view or sane conbination of the functional areas. 

For the analysis, belief-strength was measured 
on an 8-point scale ranging frcm (1)_ Certain tte 
candidate needs more training, to eight (8) Certain 
the candidate is carpetent. 

There ms a restricted mean range of scares 
(6.03 - 7.39) for the certainty of judgment rating. 
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Results of the factor analysis indicated that 
Fair Factors were used in the certainty of judgment 
rating. They were: 

• Factor I CHUD RELATED FUKCTIC^JS 

Creative, language, individual strength 
cognitive, self -concept, and social functional areas 
loaded on this factor. 

• Factor II PHYSICAIv^SWIRa^MENT 

Physical and environment functional areas 
loaded on' this factor, 

• Factor III SAFETY 

Safe, health, group managonent, social and 
self-concept functional areas loaded along with the 
global judgment, 

• Factor IV HOME/STAFF 

Hone center and staff loaded on this factor. 

There wasn't an overall general basis that was 
used to judge candidate perfonnance. Four distinct 
factors were involved with the first factor account- 
ing for the greatest amount of explained variance. 

The eval^aation assumption was rejected. The 
lAT manbers did not use an overall general basis to 
judge candidate performance, 

Qjesticffi three ; Did the Assesanent Process Differ- 
entiate? 

Results ; Fiffc/ percent of the candidates were judged 
cai^^etent by LATs in all the Functional Areas, vMle 
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85 percent were judged corpetent in at least nine 
of the thirteoi Functional Areas. Eighty-five 
percent of the candidates were judged cor^^etent. 

Within each of the Functional Areas ^ there was 
a greater tendency for lATs to vote candidates as 
needing more training. For exairple^ 25 candidates 
wsre found to need more training in the Cognitive 
area; 21 in the Creative area. Only three were found 
to need more training in tte Safe Functional area. 

The results indicated that the distribution of 
catpetence was skewed. There was a high percent (85%) 
of judgments of "coipetent candidates". However^ it 
spears that this was a result of uncontrollable fac- 
tors which may have confounded the result. These 
factors deal with the apparently intensified prepara- 
tion, high level of experience of the sarrple, and 
selection factors. 

The evaluation assxjimption was supported in a 
limited way. There was a range of Incorpetent or 
Needs more Training of Candidate performance judged 
fcy LAT manbers. The overall successful rating of 
competence suggests that the candidates were pre- 
pared and motivated to be judged coipetent. 

Question four ; Were there side effects? 

Results : Par^ts, For most Parent-Ccranunity Repre- 
sentatives, LAT participation was primarily a learn- 
ing experience. Parents learned new things about 
child development and about tteir own children. 

Results : Trainers . For tte Trainers of CDA Candi- 
oates, participaribn in the LAT seoned to have two 
Jcinds of side effects. It focused tteir contacts 
with trainees on specifics — the Functional Areas ^ 
and gave them an opportunity to assess their train- 
ing programs. 
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Results: Candidates . The side effects of the assess- 
ment process on candidates came fron several sources; 
ccmpilation of the Portfolio; feedback fron the lAT 
meeting; and a reinforconent of their professional 
role and awareness. In developing their Portfolios, 
candixiates became more aware of their own knowledge 
and better able to organize it. LOT feedback led one 
candidate to implonent a vrookrorking program, with tte 
help of someone fron the coirnunity, focusing on large 
and small muscle control. For another candidate, the 
LAT meeting discussion prorpted fire drills and parent- 
teacher conferences. Another iixJicated she was teach^ 
ong her children to use blunt scissors as a resiiLt 
of the LAT assessnent. Assesanent also stimulated 
an increased sense of self-vrarth and professionalisn 
in sane candidates. The positive feedback which one 
candidate got for her work in language proipted her 
to explain her approach to other members of the center's 
staff and to hSlp than in their language activites 
In another case, the LAT pointed out sane positive* 
behavior of vdiich the candidate, herself, had been 
unaware. And one candidate reniarked that she was, 
"more pleased with the center." 

The evaluation assumption was sij^ported. Ttere 
were more positive effects than negative among the 
LM? members. 

Objective two ; To investigate tte validity of tte 
CDAC organizing schana. 

Question five; Does the CDAC Organizing Schana, vdiich 
consists of six cai?)etency and thirteen functional 
areas, have factorial validity. 

Reailts : The results of tte factor analysis on the 
functional areas ranking of iirportance proiuced four 
factors. They were: 
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• Personal/Social 



• Safety 

• Intellectual 

• Hone/Staff 

CDA's Organizing Schana \^ch is used throughout 
the creden tial in g process consists of six carpetency 
areas. The thirteen functional areas have been judged 
ard placed within each of the six areas. Tte evalua- 
tion assunpticn for this analysis projected tliat there 
vould be congruence between the six areas and the 
results of the factor analysis. 

There is a good mtch between the first ccrrpe- 
tency area and the safety factor. Tte physical 
functional area was the only incongruent area which 
loaded on the factor vten the first ocnpetency area 
was analyzed. It was concluded that there was con- 
gruency between canpetency area one and tte factor 
structure labeled Safety. 

Tte second ocnpetency area is concerned with 
advaiicing physical and intellectual, corpetence. The 
factor structiare lateled Intellectual tes three of tte 
fcur functional areas loaded on this factor. Physical, 
did not load on this factor. Cognitive, Language 
and Creative did load on this factor and provided 
for congruence with CDA's Qrganizir^ Schsta. It should 
be pointed out, however, that the Creative E?unctional 
area did split and loaded on tte personal/social factor. 

Carpetency area Two was congruent with tte factor 
structure labeled Intellectual.. A restatonent of the 
piiysical functional area and a review of the creative 
area vould telp iiipiove tte amount of congnoence be- 
tween tte factor structure and tte Organizing Schana. 
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Can[petency area Three relates to the develop- 
ment of positive self-concept and individual strength 
of the child. The factor defined as Personal/Social 
included both of these functioial areas. In addition, 
it included the tro function areas groiped into can- 
petency area Four. The fourth corpetency area is con- 
cerned with pranoting positive functionaling of child- 
ren and adults in groups. Catpetency area Three focuses 
on the individual personal development and area Four 
focuses on the social development. Ttese two areas 
were grcxcped on the same factor vMch was labeled 
Personal/Social. Ml of the functional areas included 
in oonpetency areas Three and Four loaded on this factor. 

It vrould be difficult to conclude that ttere was 
congruence between the factor structure and the two 
cotpetency axBas. There was enough similarity between 
the corponents in the organizing schana and the factor 
struct^Jres to begin to refine, tte definition of the 
functional areas or reconsider the classification 
system by the early childhood consultants. 

The fifth and sixth catpetency areas produced a 
sindlar dilenma to the third and fourth areas. The 
fifth oorpetency area is concemed with hringii^g about 
cptiiial coordination of hone and center child rearing 
practices and expectations. The sixth area focuses 
on carrying out supplementary responsibility related 
to chilxiren's programs. Both of these oarpetency 
areas loaded on the factor labeled Hone/Staff. It 
appears that there is not any clarity ard there is 
a lack of value concerning these two coipetency areas. 
The functional areas were ranked the lowest and there 
were few areas that correlated with these two areas. 

Similar to the previous concliision concerning 
congruence between CDA's Organizing Schana and the 
factor structure, there is a need to refine the defi- 
nitions of the functional areas or reconsider the 



22 

18 

I 



ERIC 



SocajoZ 



Homz/Sta^^ 
Factor 



classification system. An acJditional probl^ is re- 
flected in these two areas, however, in that both the 
Staff and Hone Center canpetency areas appear to be 
valued less than the other canpetency areas tliat are 
more directly related to the child. Tlais may be 
^propriate and there always has to be a last rank 
area. However, the fact that both of these areas were 
ranked low should be noted. 

The evaluation assunption that the CDA's six 
carpetency and thirteen functional areas will have 
factorial validity was partially supported. There 
was tactoriai validity for two of the six areas and 
the ronaining four gra:5)ed in a manner which tended 
to support the CDA Organizing Schona, Tte use of 
only one n^easure for the ranking of ii^xDrtance re-' 
stricted the investigation. Additional measures aid 
revision of sane of tte operating definitions for 
the functional areas should help irr^arove the results. 

It can be concluded that CDA's Organizing Schema 
is very good and that it does have an impressive 
anount of Construct Validity. 

Question six ; is there consistency of judgment by 
team monbers about the thirteen functional areas 
which make up the organizing schsna? 

Two analyses were accorplished to investigate 
the eva luation assuiption. The first part of the 
assumption, "LAT irCTibers will be consistently ranked 
for the three measures" was not supported. 

The Intellectual Factor produced tlie highest 
firequency of judgment that there was a need for more 
training. It also had a high value rating of its 
functional areas and the least amount of certainty 
of judgment.. This pattern continued in the Personal/ 
Social factor; three of the six functional areas had 
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on the other hand found the candidate and trainer 
above the median and the CDA Representative and the 
parent below the median. It ^jpeared that rule 
setting and the establishnent of routine v?ere more 
in?xDrtant to the wrker than to the observers of 
the TOrk. 



There \^e no differences in the Hone/Staff dJiUoJioyicLQA 
fac±ars. The safety factor had one statistical kmdj^tiTu 
differoice in the Safe functional area. Tte difference 
in rating was between ttie trainer and Cm Representa- 
tive, vto were above the median aid the candidate and 
aprent, who were below the median. 



In sutmary, the statistical difference in four 
functional areas, Safe, Cognitive, Social, and Group 
Managatent with the divergent rating of the lAT man- 
bers led to the conclusion that the evalioation 
assurrption for iirportance could not be supported. 

There were nine functional areas for vMch there 
vas a significant difference — one in the Intellec- 
tual Factor, three in tlie Hone/Staff Factor, aid four 
in the Safety Factor. 

The CDA Representative tenied to be less certain 
than the other three team monbers on the Creative, 
Social, Hone Center, Staff, Safe, Bnvicoxment, aid 
Physical functional areas where ttere was a statis- 
tical difference, in areas where there was no sign- 
nificant difference, the Cognitive and Language areas, 
the CDA Representative was below tte median. 

All nine of tte thirteen areas where there was 
statistical significance can be attributed to tte CDA 
Representatives' tendency not to te certain about 
their rating. This information and tte previously 
reported results on the Inportance and Needs More 
Training ranking led to tte conclusion that the 
evaluaticn assui^Jtion could not te supported. 
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Question Seven ; Does the 1975 field study partici- 
pant's evaluation of the CDPC Assessment System 
indicate that it is ready for use in tte Credential- 
ing Process? 

Results 

Highlights feon each of the questionnaires have 
been included to provide insight into the questions 
and the different group's responses. 



LftT Questionnaire 

There were 264 team monbers v?ho responded to 
this questionnaire. The highlights were: 

• 87% indicated their team took the time to 
discuss the role of each LRT monber 



TcZZovoaxL 



82% discussed how the infonnation was 
collected 



• 27 indicated there vas not enough tine 
allowed to. discuss infonnation 

• 92% discussed meeting operations 

• 91% used tte perfonnance standards as 
ttey were designed 

Parent/Cotmunity Representative Questionnaire 

Fifty-two (57%) of the 92 parents responded. 
Their response to selected itans on the question- 
naire was as follows: 

• 96% felt the Parent/Connunity Representa- 
tive Handbook vas useful 



Handbook 
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• 100% indicated the materials were easy to 
understand 

• 92% felt the letter to parents and the 
observation forms were easy to understand 

• 82% felt the parent r^resentative could 
do a better job with ojie training session 

When as k ed '^-Jhat should training be concentrated 
on?", the parents identified the following areas: 

• Observation of the candidate (79%) 

• IntenrLswing parents (62%) 

• The thirteen functional areas (90%) 

• The LAT meetings (76%) 

Finally, 98% of the par-:nts felt that the parent 
questionnaire was a good way to express their views 
and 56% of the parents felt that the one hour obser- 
vation of the candidate was not long enough. 

Candidate Questionnaire 

Seventy (77%) of the candidates surveyed responded 
to the questionnaire. Selected results from the ques- 
tionnaire not already treated in other areas of the 
report were as follows: 

• 100% felt the experience of making a Port- 
folio was valuable and 96% indicated that 

it helped them to prepare for tte LAT meeting 

• 34% felt thut at seme time in the process, 
they wanted to withdraw fron the assessment 
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• 99% felt that participating in the LAT meet- 
ing was valiaable 



• 94% indicated that they nad iised wiiat they 
learned fran the process 

Trainer Questionnaire 

Forty^six trainers were surveyed and thirty 
seven (81%) responded. Iheir response to tije z^o- 
cess and the identification of ar^as which worked 
well and areas which needed revision was as follows: 

• The Portfolio guidelines and the CDAC 
Representative inf ooiriation worked well 

• The Paroit Questionnaire and the Trainer's 
report needed revision 

Staff Report to the CPA Board of Directors 

The results of the follow-up questionnaire and 
staff recamendation were reported to the CDA Board 
of Directors in March 1975. The prinary conclusion 
reported to the CDA Board of Directors was that the • 
system v^s credible, workable and had desirable side- 
effects. In addition, infonnation collected in this 
study was used in refining both the assesanent pro- 
cess and the assessment materials. The results have 
been used to continue to cor^aptualize v±at happens 
to people w*o participate in the assessnnent process 
(side-effects) . . 

The Eval^aation Assurtption was suFPorted. T3ie 
f oHovMjp questionnaire provided inf ormatuHT for the 
CDA Board of Directors to move ahead with the Creden- 
tialing Systm. 
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Tha (fata collected fron the follow-up question- 
naire and the results of the First and Second Field 
Test si:pparted the CDA Board's decision to award tha 
Credential, 



CaSCEUSIONS 



The three objectives^ seven questions and eight 
evaluation assunptions were used to frame the con- 
clusions and reconnendations for the 1975 field test 
data. The following are the conclusions for each 
objective area. 

Objective one ; To determine if the CDAC Assessment 
System was ready to be xased for credentialing candi- 
dates. 

The answers to the four questions posed to ireet 
this objective revealed that: 



was 



• lAT members followed the process and there 
a sense of peership among the lAT monbers. This 



led to the concliasion that the assessment process 
was workable. 



Ofa/ecttve 
One 



• Members were certain about their judgments 
of the candidates ' perf onnance and they used at least 
four distinct factors in their decision making about 
the candidate. A conclusion that the pi^Dcess was 
credible based on the fact that tte functional areas 
were being used as intended and there was confidence 
among the team menibers about their decision making. 

© The field test results vere inconclusive about 
the ability of the LAT members to discriminate between 
ccripetent and incanpetent caididate performance. 
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The design of the field test and the restricted fcxrus 
on the lAT meeting as the basis for judging canpetence 
prevented clearer findings about the question of dif- 
ferentiation. 

# There were more positive side effects than 
negative effects on the lAT manbers. The assessment 
systan does have many qualitative dimensions^ par- 
ticularly for the candidate and parents. 

Objective two : To investigate the validity of the 
CDAC Organizing Schema. This objective required two 
types of statistical analysis to help investigate 
the validity of the thiriieen functional areas aai 
the consistency of jxodgment by team members. Ths 
validity and consistency studies of the field test 
date v^e: 



SUz 



m Validity . The results of the factor analysis 
on the rank order rating iinpor . Lance was partially 
supported with two of the six cotpetency areas fac- 
toring out conpletely and the remaining four grouped 
on the remaining two factors in a itanner which tended 
to support the CDAC oirganizing schema. It was con- 
cluded that the CDAC organizing schana has an im- 
pressive amount of construct validity as dononstrated 
in the factor structure of the rank order of rating 
of iirportanoe for each functional area. 

• Consistency . The idea that the lAT irembers 
will consistently rank the functional areas was not 
si?Dported. The analyses accarplished derroistrated 
that there vas variability among the functional areas 
and within the caiputed factors. The functional areas 
which require the most attention, given their high 
rating of importance and lew on certainty^ were: 
Cognitive, Creative, Language and Individual Strength. 
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The ceirtainty of judgment rating by the team had 
the CDA Representative generally less certain than ths 
other three inen:ters of tte team. In all the functional 
areas where there was a difference among monbers' 
certainty of jiodgment, it was the CDA Representative's 
lack of certainty v*iich contributed to the difference. 

t 

Objective three; To obtain fofLow-up infoannation from 
participants about how well Ute CDAC Assesanent Systan 
worked in the 1975 field sti^. 

The objective was a Mraiuct of ttie need to follow 
up and verify the resultsi^f the field test. The LAT 
members who parricipatedAn the field study were mailed 
a questionnaire. Findij^gs from the follow-up ques- 
tionnaire v^e used along with other field test data 
to move the credential ing systan into its first year 
of operation. The results of the questionnaire si^)- 
ported the decision to proceed. Respondents tended 
to be positive with the primary conclusion that the CDAC 
Assesanent System was credible, workable and had desir- 
able effects. 



RECCMMS»ATI0N5 

The field test produced a series of recormenda- 
tions. The consortium should: 

1. collect dLnfontiation which may be used to 
verify that the teams are following the required 
process. 

2. monitor lAT voting patterns and analyze team 
de£^'::ision data to determine if one team monber is con- 
sistently outvoted. 

3. extend the right of appeal to all team memr 
bers and collect inf ormaticn which will indicate the 
effect an ^jpeal mechanian has on the assessment process. 
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4. continue efforts to iinprove the quality of 
documentation and to collect data on docunentation 
viiich admits of public review* 

5. develop a more detailed theoretical descrip- 
tion of cultural adaptation and investigate the func- 
tioning of LATs to detennine whether it is, in fact, 
occurring. 

6. conduct research on those variables which VotiinmuiQ. 
might explain the high success rate of candidates o,.!'^^ 
for the CDA credential. 5acce44 



7. monitor and analyze LATs according to the 
ethnic classification of candidates to identjLfy a 
racial classification in its assesanents, 

8. incorparate the beneficial side effects of 
the assesanent process into the system. 

9. continue to design and evaluate studies vfeLch 
test the construct validity of the corpetency and 
functional areas. 
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EV7^3JIATION OF TEIE CPA OgDEMTALING 



AWARD SYSTSyi^S FIRST YEfiR OF QPERATICN 



INTRODUCTION 



The Child Developnent Associate Consortixro's 
Board of Directors' decision to iitplement the CDA 
Credential Award System signaled tte end of the 
developriental stage of the assessment system and the 
beginning of the operational stage. The consortium's 
organizational development evolved to a point durii^ 
1975-76 when an evalxaation of the effects of the CDA 
Credential Award System was appropriate. 

The purpose of the evaluation of tte CDA Creden- 
tialing Award System's first year of operation was 
to determine how well the system was working and 
identify areas where there was a need for , revision. 
The first and second field tests helped to nold and 
structure tte phases of the Credentnaling Award System, 

OB»IE)CTIVES 

There were four objectives/ seven questions and 
ten evaluation assucnptions used to structure the eval- 
uation. The objectives and related questions for the 
evaluation of CDA's Credentiali3ig Award System's first 
year of operation v^re: 

• To evaluate how successful enrollees in the 
CDA Award System were at achieving a credential, 

• To determine how well the CDA Award System 
and lAT meetings vrorked. 
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• To investigate the validiirir and reliability 
of the CDA Award System' s six cotpetencies and thir- 
teen functional areas. 

• To investigate areas v?hich v?ould enhance the 
CDA Credential ing System* 

SAMPIiE 

The sarrple selected to participate in the evalua- 
tion of CDA's credentialing system \ms dravzn frcm the 
cred<fantialed caixiidate list as of June 25, 1976. A 
list of the one hundred most recently credentialed 
candidates who had imigue teams was corpiled* This 
list inclxjded candidates vto were credentialed between 
March and June 1976. It was from this master list 
that a sairple of 51 consorti-um representatives, 50 
trainers, 50 P/C representatives and 50 credentialed 
candidates were contacted arsd interviewed. There 
were: 3% Asian, 30% black, 11% Mexican American, 
4% first American, 48% vMte and 4% no information 
on background. 

HTGHLIGHTS CF THE FINDIN3S 

Objective one ; to eval^aate hew successful enroUees 
in the CDA Award System were at achieving a credential. 

Qjestion one; Hew successful have enrollees been 

in achieving the Child Developrient Associate Credential? 

Results ; A total of 3,340 have enrolled in the CE3A 
process* Five hundred sixty-one (561) have been cre- 
dentialed and 456 are ixi the candidate stage with 
2,333 in the enroUee status. CDAC has produced 17% 
credentialed candidates or successful enrollees. 
It is interesting to note, however, that oix::e the 
enrollee proceeds to the lAT meeting ths rate of 
success is over 99%. CDA process requirenients provide 
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for self -initiation of assessnent ardf therefore, the 
CDA System pemits individuals to include or exclude S(ili-inltijoutzd 
themselves from the process. The significantly large k^^^umznt 
number of enrollees vrtio do not proceed to the cardidate 
stage is attributed to a variety of reasons* Follow- 
mailings and telephoning of enrollees revealed the 
folloving: clianged jobs, no place to be assessed, 
just interested in infonnation about CDA, and changed 
mind after reviewing requirements* 

The evalxiation assurrption that at least fifty 

percent of the enrollees have been credentialed vas Re/ecnted 

rejected * Actually only eighteen percent have been k64itmptAJO 
credentialed since the inception of the credential* 

Objective two ; to determine how well the CDA award 
system and lAT meetings wDrked* 

Question one ; In general, hw is the CDA credential- 
ing system viewed by successful candidates and the lAT 
manbers, parents, trainer and CDA representatives* 

Results; 



• By and large all the respondents were very 
enthusiastic and positive about the various itens 
in the CDA and LM? procedures* 



m The average ratings on the two most favor- 
able items of the numerous four point scales ccrtibined 
exceeded 90% .in most cases, in sane cases they equalled 
100% (i.e*, very clear, excellent)* 

• If the mDSt favorable item in the scales con- 
cerned with clarity, importance, excellence, etc* is 
used as a criterion, the CDA Reps were the most criti- 
cal respondents, followed by the trainers, candidates 
and the parents. The CDA Reps rarted 49% of the 75 
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items on t±ie questionnaire below 50%, the trainers 
23%, the candidates only 8% and the parents 1%, On 
average, 20% of the itons did not achieve the 50% 
level in the most positive category for rating, 

• The activities vd.thin the steps of the lAT 
ineeting were the major source of confusion (4 out of 
10 of thetn averaging below 50% on very clear) followed 
by the principles (25%) , portfolio (17%) , steps of the 
LAT meeting (14%) and items in the Credentialing Systan 
(13%) . The other three areas each had less than 10% 
of their ratings below 50%. 

. • The CDh Reps were the only group asked to rate 
the sections in the Consortium Representative Proce- 
dures ^^anual. In keeping vd.th their critical stance, 
6 of the 10 steps received ratings below 50% for very 
clear. 



uxutlun 
LAT 



m There was general agreement as to the most inrt- 
portant coipetency area, "builds positive self concept 
and individual strength", ranging from 34% to 50%. 
The least important area was "carries out supplementary 
responsibilities related to children's programs" rang- 
ing from 32% to 50%. 

• The nost irtportant functional area in each 
of the groups was "self- concept" averaging 43%. The 
least inportant area was "staff," 16% to 28%. 

• A substantial number of respondents used sore- 
thing in the decision making process other than the 
functional areas ranging from 62% of the trainers to 
30% of the candidates. 

• The parents were the least enthusiastic about 
a need for more structure in the CDA Guidelines Hand- 
book about vtet should be in the Portfolio (22%) vs. 
ratings of 54 to 65% for the other three groups. 



ImponXayvt 



32 



ERIC 



• All four groups felt the candidate vas the 
most irrportant inember of the LPff in tte Credentialing 
Syston (65%, 56%, 44% and 44%), Respondents showed 
remarkable restraint in voting for thenselves as the 
most iinportant manber of the LRT in this regard — 
only 14% of the reps, 10% of the trainers, 12% of 
the parents and 44% of the candidates were the most 
impc^tant (this 44% does not appear to be self- 
aggrandizonent) . 
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• with the exception of the Parents (vdio voted 
for the CDA Rep) each of the other groups thought thsy 
had the most influence on the final decision. 

• If it were necessary to eliminate one role 
from the team, the Barent was the leading choice for 
all four groi^DS (38% to 56%) . 

The evaluation assunption that the CDA credential- 
ing system will be viewed positiviely ty lAT members 
was accepted. There tends to be a general positive 
view expressed by the interviewed lAT numbers. Areas 
of concern were also identified and possible revision 
after further study appears to be appropriate. There 
doesn't appear to be a great need to change any of the 
basic concepts or approaches in the system. 

Question two ; How well is the CDA Credentialing Award 
Syston working? 

CDAC representatives, credentialed candidates, 
trainers and P/C representatives were asked to evaluate 
their roles as described in the various manuals and 
handbook. They were posed questions about clarity 
and satisfaction with the way activities were described. 
In addition, tvo questions were asked about the clarity 
and the amount of problons encountered in ccnpleting the 
required forms. The following are highlights fron 
the results. 
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CDAC Representative 



Manual 



The ten sections of the manual all were rated 
very clear or clear by at least 90% of the 
CDAC Representatives, The CDAC Representa- 
tives' satisfaction rating of the ten sections 
of the manual tended to be lower than the 
clarity rating. Eight of the ten sections v^ere 
rated very satisfied or satisfied by at least 
90% of the CDAC Representatives \/diile tte 
Contact and Screening and lAT meeting sections 
of the manual received satisfactory or very 
satisfactory rating of 87% and 86% respectively. 

• Fonns 



There are eight forms that tha CDAC credential- 
ing system uses that must be completed by tte 
Consortium Representative. There was only 
one form that received less than 50 percent 
rating of very clear. It was the meeting 
profile form. This was the same form that 
had 45% of the CDAC representatives iniicatir^ 
that they had soanne prdblons with understanding 
the form. 



Rcuting 



Rating 



Candidate 



Handbook 



The candidate's role in the credentialing award 
syston is described in the CDA Handbook. Ttere 
are twenty activities detailed in the Handbook 
and successful ccnpletion of each activity is 
required of all credentialed CDA's. At least 
90 percent of the candidates responded that 
seventeen of the twenty activities were clear 
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or very clear. The three activities which 
received less than ninety percent were: 



• Beginning to collect information by 
developing your portfolio 78% 



• Ccnpletir^ your Portfolio 



• Participating in LAT meetings 



86% 



84% 



These three areas also received the greatest 
percentage of unclear ratings with the LAT 
Meetirg receiving 16 percent unclear^ con- 
pleting portfolio 14 percent and developing 
portfolio 12 percent. The only other activity 
that might be considered for further study is 
the mailing of the octipleted enrollment form 
to CDAC. It only received a 48 percent rating 
of very clear. 

Forms 

There are eight forms that tlie CDA candidate 
must cotplete in the credentialing process. 
Candidates were requested to rate the clarity 
of the forms and hew well the form was under- 
stood. There was only one form vAiich received 
less than 90% rating of clear or very clear. 
It was the guidelines for developing the port- 
folio. Fourteen percent (14%) rated the guide- 
lines as unclear. 
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Trainer 



Handbook 

The trainer role in the CDA credentialing award 
system involves nine activities according to 
the Handbook. Clarity and satisfaction ratings 
were made by interviewed trainer. Three of 
the nine activities received a rating of less 
than at least 90 percent clear or very clear. 
The three activities were: preparii^ for the 
lAT Meeting (86%) ; participating in the lAT 
Meeting (84%) ; and^ returning profile and 
other assesanent materials to the consortium. 



BaZou) 
90% 



39 



35 



EKLC 



Preparing f or the lAT Meeting was rated the inost 
unclear activity (14%) followed by returning 
profile and other assesanent materials (12%) 
and participating in the lAT Meeting (10%) . 
The same three activities received the lowest 
satisfaction rating. 

• F orms 

Six forms are corpleted by the trainers dLn the 
CDA Credentialing process. Trainers were 
asked to rate the clarity and their understanding 
of the fonns. All six of the forms were 
rated very clear or clear by at least 94 per- 
cent of the trainers. Their rating on the 
amount of problems they had understanding the 
forms revealed that there were at least seme 
problems with the trainer's report on the 
candidate (18%) and the ccxnpetency standard 
form (12%) . The other forms all were rated 
by at least 90 percent of the trainers as 
having no problem understanding tte forms. 

P/C Representative 

• Handbook 

P/C representatives are involved in eleven 
activities as defined in the CDA Haidbook. 
Their rating on the clarity axvi satisfaction 
of the activities were exceptionally high. 
The lowest rating was 92 percent with two 
areas rated 100% clear or very clear. There 
were similar results about t}.ie parent satis- 
faction with the way the activities worked 
in the process with four activities being 
rated very satisfied or satisfied by 100% of 
the parents interviewed. 

• Forms 

Ihe eight forms that the parents completed 
in the process v^e rated on clarity and 
understanding. All eight forms received 
exc^ionally high ratings on clarity with 
all forms receiving at least 96 percent clear 
or very clear rating. The Icwest rating was 
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on the parent questionnaixe which had two per- 
cent of the parents indicating that the parent 
questionnaire vTas very imclear. OSie parents 
tended to have seme or many problons with five 
of the eight forms. They were: . 



• cm Application Form 18% 

• Parent Questionnaire 32% 

• Master Questionnaire 26% 

• Parent Observation Form 26% 

• Coipetency Standards 20% 



lAT Mennbers; Rating of Portfolios 

There v^e twelve questions asked of lAT inan- 
bers about the portfolio. Six of the questions about 
the portfolio related to how useful the portfolio 
was in the credentialing process. The results were: 

• The CDAC representatives tend to rate the 
usefulness of the portfolio lower than all 
other team members for five of the six 
areas. 

• There is a statistical difference among 
team members for three of the six areas 
which can be attributed priitarily to the 
CDAC r^xcesentative exclusively in two of 
the areas and partially along with the 
trainers in the other area. 

• There are no ratings below 78 percent and 
the node for all roles in the six areas 
vas 96%. % 

Trainers Report 

Ihe trainers report on the candidate is one 
of the iirportant elements in the LAT process. The 
lAT members rating of iit^Dortance of the trainer 
report showed that: 
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98% of the candiates, 100% of the P/C rep- 
resentatives and trainers thought the 

trainer's report was irrportant or very 
irrportant. 

91% of the CDAC Representatives thought 
the report was irrportant or very important 
with only 59% of the CDAC representatives 
indicating that it was very iirportant. 



Parent Opinion Questionnaire 



The P/C representative performs a parent opin- 
ion sunmary about the candidate. The questionnaire 
is sent to the parents of the children in the program 
when the candidate is working. lAT members were 
asked to rate the iirportan.ee of the parent opinion 
questionnaire. The results of the ratmg were: 

• Over 50% of all the team members in each 
role rated the questionnaire as very 
irrportant, 

• 98% of tte candiates, and 96% of the CDAC 
representatives and P/C representatives 
rated the questionnaire as very iirportant 
or iirportant. 

• 10% of the trainers rated the question- 
naire as unimportant or very unimportant. 

The evaluation assurrption that the candidate, 
trainer, parent and consartium representative will 
rate: 
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their role as clear, appropriate and work- 
ing well was accepted . 

the forms they must ccnplete in the process 
as clear and indicate that there were no 
problems in corpleting the forms was par- 
tially accepted . There were problems 
with the candiate's portfolio activities 
and forms and the P/C representative's 
parent questionnaire. In general all 
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forms were rated clear and lAT inanbers 
did rot encounter problens in cotpleting 
them. 



3. the portfolio as useful, iirportant and 
beneficial in the IaT process in the LAT 
meeting and to the candidate was accepted . 

4. the trainers report and parentis question- 
naire as iirportant to the credentxaling 
system vas acc^ted , 

Cfcjective three ; to investigate the validity and 
reliability of the CDA Award System's six oorpeten- 
cies and thirteen functional areas. 

Question one ; To v*at degree does the CDA creden- 
tialing system have construct validity? 

Results 

Three factorial studies were accorrplished to 
evaluate the CDAC cotpetency areas' construct val- 
idity. The first analysis was designed to evaluate 
the rating patterns of fift^-one IAT manbers on the 
preform. The preform requires that the team mon- 
bers rate the candidate on the thirteen functional 
areas and on the final decision. A six point scale 
was used to rate the caididater with zero equaling 
needs more information, and a score of five repre- 
senting an excellent for the corpetency rating. 

Pre-Form Factor Analysis 

The functional areas factored into three 
urderlining factors with th^ final decision split- 
ting on the first and thiiu factor. An- analysis 
of the distribution of factor loadings among fac- 
tors suggested that the factors should be called; 
Safety, Intellectual/Social, and Hone/Staff. 

Safety Factor 

The Safety Factor was the second factor and 
it accounted for nine percent of the variance, it 
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had unique loadings for the Safe, Healthy, Environ- 
ment functional areas, viiile Physical and Grojp Manage- 
iT^t split on the first factor. The functional area 
ratings by the LKT manbers termed to support the 
ranking of iirportance factor structure in the 1975 
Field Test. The first four functional areas loaded 
together on the ranking of iirportance rating during 
the 1975 Field Test and the LRT monbers, in the use 
of the pre-form, tended to use the functional areas 
in a sijTiilar manner as they rated the candidate. 

Intellectual/Social Factor 

This factor had all the functional areas that 
related directly to the child's development. All the 
loadings were moderate to high and the factor struc- 
ture accounted for eighty-four percent of the var- 
iance. The final decision vote also loaded on this 
factor; however, it split on the third factor. 

All of the functional areas on this factor 
related to the child's develqp:nent; however, there 
VTasn't any discrimination among the intellectual 
type areas and the Self-Concept type areas. In the 
Field Test results this distinction was made in the 
ranking of importance. The pre-form ratings do not 
appear to involve this type of discrimination. 

Staff/Home Factor 

A third factor accounted for eight percent of 
the variance, with four functional areas loading on 
the factors; Creative, Hone Center, Staff aid Final 
Decision were the areas that loaded on this factor. 
The relatively high loading of Home Center and 
Staff were similar to the ranking of iirportance in 
the 1975 Field Test. The split loading of the Final 
Decision on this factor suggests that there were two 
factors underlining the decision making by the lAT 
manbers. This decision making process, although 
different from the ranking of importance in the 
Field Test, does appear to have sane validity. 

In surmiary, the three factor structures for 
the pre-fom tended to r^licate the findings of the 
Second Field Test. The functional areas did groap 
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logically^ even though they did not produce an iden- 
tity image of the Six Corpetency Areas. There was^ 
however^ a pattern of factor structure v?hich si:?>- 
ported the construct, it does appear that the lAT 
ironbers are synthesizing the functional areas into 
three factors^ as they make decisions about tte can- 
didate. The splitting of the final decisions on two 
of the three factors suggests that only two factors 
may be at work in the decision making about candi- 
date ccarpetency . . . namely, Intellectual/Social 
and Staff /Hare. 

The evaluation assurtption that the pre-form 
voting record of lAT members \7i21 danonstrate that 
the cm Credentialing System has factorial validity 
was accepted partially. There was sane congruence 
between the factor structure of the pre-form and the 
six conpetenc^ areas. The three factor structi:a:e 
was partially caused by the limited number of rating 
for each functional area. Another possible reason 
for the variance between the field test results on 
Rating of Irrportance can be attributaa to the dif- 
ference between what is said to be valued (ideal) 
and the way ratings occur in an evaluation setting. 
Specifically, people may say they value many things- 
Hov\Hver, when required to perform,the underlying 
structure of decisicn making is reduced to a minimum 
of factors for making decisions. 
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Voting Form Factor Analysis 

Factor one included four of the six carpetency 
areas with none splitting on the second factor. Self 
Conoept/Individxaal Strength, Children and Adults in 
Groups, Hone Center and Supplonentary Chiiaren's 
E^ograms corpetency areas loading on this factor, 
along with the final decision. 

Factor two incli;ided Safe/Healthy and Physical/ 
Intellectual Carpetence. Two of the functional 
areas fran the second corpetency area split on to 
the first factor. They were. Physical and Creative. 
With this excepticn, the six corpetency areas main- 
tained their internal structure on the two factors. 

The results of the Factor Analysis suggest 
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t±iat the lAT mambecs' rating further synthesized the 
six coTpetency areas fran tte three factor struc±ure 
that evolved fran the preform to a two factor struc- 
ture on the voting form* Siinply stated, two things 
seen to be involved in the decision making of a can- 
didate's ccrrpetency. First, there are the six func- 
tional areas v*iich have been grouped into the first 
and second ccttpetency categories and second, there 
are the seven functional areas vMch have been cate- 
gorized in the remaining four cannpetency areas. 

Ihis tWD dimension decision maJcing process 
appears to take tte form of tangible (necessary 
condition for success) and intangibles (sufficient 
conditions for success) • The Tangible factor, \7hich 
consists of Safe, Healthy, Environment, Physical, 
Cognitive, Language, and Creative function areas, 
provides for all the necessary conditions vMch 
must be included in the repertoire of candidate's 
behavior in caring for the child. The Intangible 
factor consists of the remaining seven functional 
areas, final decision and sequence of the physical 
and creative functional areas, vAiich split on this 
factor* This Intangible factor provides for the 
highly valued Self-Concept functional area and the 
ICMly rated social area (vMch LAT manbers did not 
want to eliminate) . The exclusive loading of the 
final decision on this Intangible factor suggests 
that the various functional areas which load on this 
factor provided enough degrees of freedom for de- 
cision making among the diverse LAT members. Fur- 
thermore, tte factor structure's internal consistency 
among competency areas suggests that it may be pos- 
sible with the developnent of additional items of 
jiidgmenfc for the team to evolve a six carpetency 
airea factor structure. 
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In surtnary, factorial validity of the GDA 
Consortium ccnpetency areas was dononstrated in a 
linited manner. Hhe tvro factor structure of the 
Tangibles and Intangibles provided the basis for the 
LAT members decision making. Tangibles appeared to 
serve as a basis to review the necessary conditions 
required for a judgment of a candidate's ccnpetency, 
vdiile the Intangibles provided the sufficient con- 
dition for a judgment of a coipetent candidate. 
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Fac±ar Analysis b£ -the Ccgrpetency 
ax)d •Func±iQnai Areas^ Rating of 
In^xirtance 



LAT mombers interviewed during the evaluation 
of the operational stage vere asked to rate the impor- 
tance of the six cotpetency and thirteen func:±ional 
areas • A scale of one to four vas used, with one 
representing Very Uniirportant and four being Very 
Irrpoirtant. There were four factors \Aich accounted 
for 100 percent of the variance. The nineteen 
variables analyzed "were similar to the analysis 
perf oimed on the rank order of irrportance rating ac- 
cdtplished in ttie 1975 Field Test. The difference 
between the tro analyses was: the addition of the 
rating on the six ocn^^etency areas; and, the scale 
used to perfom the rating. The additional 
tency areas, however, did produce a sanev^at different 
factor structure. There is a strong tendency for the 
corpetency and functional areas to ronain internally 
consistent even though they are rated in a similar man- 
ner. Variations of scale length and additional itens 
for rating the functional areas should provide a 
clearer picture of the CDAC's organizing schema used 
in the assessment. 
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Bie first factor accounted for sixty-three 
percent of the variance. None of the six corpetency 
areas loaded on this factor. Two categories of the 
ccctpetency area were included on this factor without 
any splitting on any other factor. All the func- 
tional areas included in Physical/Intellectual aid 
Social/Individual strength loaded on this factor. 
In addition, the environment functional area loaded 
on this factor ani social split on this and the 
third factor. It is interesting to note that all 
the functional areas on this factor related directly 
to the early childhood program activities. 

The second factor accounted for eighteen per- 
cent of the variance. Four of the six cctrpetency 
areas loaded on this factor. They were: Safe/Healthy, 
Physical/Intellectual, Self -Concept/Individual 
Strength, and Child/Adult Groups. Not one of the 
functional areas loaded on this factor and there 
was not any splitting of loadings. This was a pure 
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cxnpetency area factor. 



The third factor v^ch accomted for twelve 
percent of the variance \vas the most interesting in 
the structure, it \vas the only factor stjructure which 
had loading from both the corpetency areas and func- 
tional areas consistent with the CDAC organizing 
schema. The Hone Center and Supplementary Program 
conpetency areas loaded on this factor as did the 
Hone Center and Staff functional areas. Each one 
of these functional areas makes xsp the corpetency 
area in the organizing scheiia. The other function- 
al areas viiich loaded on tliis factor v?ere Grcxxp 
Managonent and Social. Social split on factor one, 
altliough it had a stronger loading on this factor. 
Can[petency area fo^Jr, Children/Mult Groip, is used 
to categorize these two functional areas. 

The fourth factor accounted for seven percent 
of the variance and it had two functional areas 
loading on it. Functional areas. Safe and Healthy, 
vMcdi are categorized in the first competency area, 
loaded on this factor. There was no splitting of 
loading, and no other area loaded on the factor. 

In sunmary, it can be concluded that there 
was some consistency between the factor structure ard 
the CDAC organizing schema. The factor structure did 
not develop as pure when the six ccnpetency areas 
and the thirteen functional areas were used as a 
standard. There was one factor structure which 
began to develop this type of structure. The other 
functional areas maintained a logical grot^^ing con- 
sistent with the CDAC schsna; however, there was 
not enough variation in the judgment to produce a 
more ideal factor structure. 

The four factors tended to mainta logical 
groupings of the functional areas v*ich ^^are intern- 
ally consistent with the CDAC organizinr schana. It 
may be concluded that there was seme co" istruct 
validity and that the CDAC organizing • diana can 
serve as an excellent model for fuirther eva].uation 
to establish the validity of the CDAC Credential 
Award System. 
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The evalmtion assurrptians that: 



o The pre-form voting record of lAT team moribers 
will denoristrate that the CDA Credentialing sys- 
tem has factorial validii^ was partially accepted • 

o The voting form record of LAT members will demon- 
strate tliat the CDA Credentialing Systan has fac- 
torial validil^ was partially accepted. 

o lAT irembers interviewed on the thirteen functional 
areas order of iirportance, consistent with the 
CDA's six canpetency areas, was partially ac- 
cepted. 

Question two; Are the LAT monbers' voting patterns 
on the pre-f con and voting form reliable? 

Results : The second more jirportant characteristic 
of a measuring device in the behavioral sciences is 
reliabilil^. Reliabilil^, or consistency, is cen- 
tral to any sowd evaluation. The CDAC uses LRT mem- 
bers to make judgments about the connpetency of the 
CDA's, In effect, the system has been designed 
in a manner which assiames that if the assesanent were 
to be repeated with another set of LAT meiribers, but 
with the same functional areas, the variance between 
the differences on mean ratings of the LAT members 
is part of the error of measuranent, and does not 
represent any systanatic source of variation. When 
this assurrption is made, a metliod corrmonly used to 
estimate reliability is analysis of variance. 

It is recognized, hot'i^ver, that mean ratings 
by individual lAT monbers represent a systennatic 
frame of reference in the rating. When this oc- 
curs, the source of variation due to differences 
between these means should not be considered part 
of the error of neasuronent, and adjustment for 
the differences in the frame of reference (of lAT 
men±)ers) should be carputed. 

An analysis of variance to estimate relia- 
bility of team jxjdgment and the related adjusted 
estimate of reliabilily was oonputed for f ifly^ne 
Local Assessn^ent Teams. A total of 153 carputed 
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and adjusted estijnate^ of reliability \^ere corputed 
foo: the pre-fom, voting form, ani both ccnrbined. 



The pattern of the adjusted reliability sug- 
gests that they be used as the basis for determining 
reliability, Furthenrcre, the scale (zero to five) , 
for the Preform termed to distort the prefom and 
ccnibined estimates of reliability. Therefore, the 
analysis of tte results focuses on the voting fom. 
Both the preform and canbined computations produced 
sane respectable reliability; however, the voting 
form vas used as the basis for the decision making 
in the determination about the CDA's ccnpetency. 

Thirteen (25%) lAT reliabilities were rated 
excellent: three reliabilities in the .81 or above; 
and, ten in the .71 to .81 range. Fifteen (29%) 
were rated good, with nine in the ,61 -.7 range, 
and six in the .51 -.6 range. Fair ratings were 
given to eight (16%) LaT's. Three were in the .41 - 
.5 range and five were in the .31 -.4 range. A 
total of fifteen (29%) received a poor rating. 

It is interestiiig to note, that when an in- 
vestigation of sanpling the poor and fair LAT's 
ratings was acccmplished^ it showed: 

o there tended to be little or no variation 
in the way one or two members of the lAT 
rated the functional areas. Actually, v*at 
occurred was that an lAT mariber voted, using 
a 3 or 4 for all functional areas. This 
produced a problon in the statistical cotpu- 
tation of reliability, even thou^ there 
was consistency of judgment on the part 
of the lAT manber. 

o there wasn't any one meiriber of the team 
that tended to vote a consistent pattern. 
In other words, the poor and fair relia- 
bilities were as likely to be caused by 
the CDAC representatives, the trainer, 
the candidate and the parent. 

In sumnary, there were 55% of the lAT esti- 
mates of reliability of judgment, vdiich were good 
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or excellent (i.e, ,51 to .89). Fifteen percent 
were fair (.31 -.5) and twenty-nine percent were 
poor (belcw .3) . It was concluded that the relia- 
bility of lAT member^s judgment was good. 

The evaluation assurrption that the voting 
patterns of the lAT inaribers will be reliable for 
the voting form was accepted . 

Objective four ; to investigate areas vMch would 
enhance the CDk Credentialing System. 

Question ; Should the CDA Credential be enhanced by 
awarding acadotiic credit for achieving the creden- 
tial; structuring the portfolio further; aid, requir- 
int a written test before the LAT meeting? 

Results 



EvaliicuUon 



Acadguic Credit for CPA Credential 

The question concerning acadectiic credit was 
asked of all LAT inaribers. Ninety-two percent irxii- 
cated that acadonic credit shoiild be awarded for 
the credential. The CDAC Representatives were the 
most negative, followed by the parents. When the 
question was posed as to hew many academic credit 
hcurs should be awarded there were as few as two 
and as many as ninety hours given as a response. 
The nedian number of credit hours for the total 
groups was eighteen credit hours and the mode was 
sixty credit hoxirs. P/C Representatives median was 
nine credit hours with a mode of three. The CDAC 
Representatives bad a median ard a mode of fifteen 
\*iile the trai ne r and candidate had the same median 
of thirty credit hours. The mode for the trainers 
was thirty credit hours while the candidates was 
sixty credit hours. Fourteen candidates resporded 
with sixty credit hours and were joined by ten other 
lAT members. 

In sumrary, with one exception of the parents 
at least fifty percent of the lAT members indicated 
that at least eighteen acadanic credit hours should 
be given for the credential. The most frequently 
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responded number of credits that should be awarded 
was sixty which was caused primarily fcy the candi- 
date 's response. 



Structuring the Portfolio 

The portfolio plays a very iinportant role in 
the LAT process • As it was previously discussed in 
the evaluation of portfolio^ it may be one of the 
reasons that unsuccessful candidates do not corplete 
the assessnents. Many reccnmeixJations have been made 
about the portfolio in the development of the CDAC 
assessnent sysban. Central to the design wcork on 
the ^ system was the concept of structure of the port- 
folio. When the question was asked of the lAT mon- 
bers about the need for more structure^ the response 
was divided with 51% yes and 49% no* There was a 
statistical chisquare difference (.01 level) among 
the lAT members vMch may be attxibuted to the P/C 
representatives. Only 22% of the P/C representa- 
tives wanted more structure, 65% of the CDAC rep- 
resentatives^ 54% of the candidates and 62% of the 
trainers indicated that there was a need for ircre 
structure, in response to the question shoxild there 
be a list of things \diich should be included in the 
portfolio 68% said yes and 31% no. There was a 
chisquare statistical different (05 level) among the 
LAT members response. The trainers 5.8% aid caxxii- 
date 60% were Icwer in these positive responses than 
the CDAC representative 80% and P/C representatives 
76%. 
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In sunmary^ three of the four lAT mahbers see 
a need for more structure in the guidelines for the 
portfolio. The parents were the only members v*io 
did see the need. There was a concensus that a list 
of things to be included in the portfolio should be 
developed and included in tte handbook. 

Written Test Before the lAT Meeting 

One of the recotmendations that has been made 
about the CDA credential award systan is that a writ- 
ten test should be given to the candidates before 
the lAT meeting. T-flhen this question was posed to 
the LAT members 51% disagreed or strongly disagreed 
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with the recomendation to ac2rriijiister a written test. 



There was a chiaquare statistical difference 
(.01 level) anong the lAT inanbers response to the PaJtzrvCs 
written test questicn. 75% of the parents agreed 
or strongly agreed that a written test diould be Tz6t 
given before the LAT meeting. There were 42% of the 
CDAC Bi^resentatives, 40% of the caxxiidates ard 
36% of the trainers who agreed with the parents 
response. 



In sunmary^ the recormendation about a writ- 
ten test before the LAT Meeting divided the lAT mem- 
bers with the parents tending to agree' with the recan- 
roendation-. The other lAT iranbers were ^iso divided? 
bo^^ver^ there was a tendency to disagree with the 
trainer being the most negative about the recarrosnda- 
tion. 



Ihe evaluation assurrption that: 



• at least fifteen credit hours should be ■• ■ 
awarded for achieving a CDA credential was 
accepted. 

4.U , . . Evaluation 

• the CDA portfolio does not require more A^^^mrDtion 
structure was rejected. 

• a written test for the candidate is..not 
necessary before the LAT meeting was 
acc ep ted . 

Concl\asiQns- and- Rsccrmenaations 

Conclusians 



Four objectives/ seven questions^ ard ten 
evaluation assutipticns were used to organize the 
conclusians and reccmnendations. The following are 
the ccaiclusions for each cfcjective area. 

OD^ective one ; To evaluate how successful enrollees 
in tte CDA Award Systan were at achieving a cre- 
dential. 



One question was used to achieve this objec- 
tive. The answer to the question was: 

9 17% (561) e n ro l l pes have been credentialed^ 
1.4% (456) are in the caniidate stage and 
69% are in enrollee status. CDAC award sys- 
tan pennits the enroUees to progress at 
their own rate. It is a type of individu- 
alization of assessment which is co n trolled' 
by the enroUee, Once the enrollee rroves 
throijgh the application process into the 
assessment phase there is a high rate of 
success. Actually 99% of the candidates 
who have reached the assessment phase have 
been credentialed. 

Objective two ; to determine how well the CDA award 
systan and LAT meetings works, 

Ansv^s to the three questions posed' to meet 
this objective revealed that: 

• There tends to be a general positive view 
expressed by i±B 201 interviewed LftT msn- 
bers. Areas of cancem about the process 
were identified; however, further study 
prior to revision is v?hat is required/ 

• The results do not indicate a need to change 
any of the basic concepts or approaches in 
the system. 

By and large all the respondoits were very 
enthusiastic and positive about the various 
CDPi and LAT procedxares, 

• The average ratings on the two most favor- 
able itons of the numerous four point scales 
continued exceeded 90% in most cases and 
in sane cases they equaled 100% (i,e. very 
clear, excellent) . 

• All groups felt the candidate was the most 
important manber of the LAT in the ere- 
dent ia ling systan. 
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• If it were necessary to eliminate one role 
fran the team the parent was the leading 
choice for all four groc^DS (38% to 56%) • 

• The CDAC Representative, candidate, train- 
er, and P/C Representative viewed their 
role as clear, appropriate ard working 
welx, 'Tnie fonns they must corplete in 
the process wer^ i-c.t'=d as clear ani they 
indicated that there were f c.-r problems 

in completing the farms* The area for 
which soiB problems were identified were 
one candidate's portfolio activities ard 
fonns and the P/C Representatives parent 
questionnaire • 

• The portfolio was viewed as useful, im- 
portant and beneficial to tlie lAT process, 
the meeting and the candidate* 

• The trainer report and the parent's ques- 
tionnaire TrjerB viewed as important to the 
credentialing systan* 

• lAT meeting principles and steps were clear, 
^jpropriate and worked well. There were 
statistical differences among the LAT memr 
hers rating of how the principles worked. 
The ratings were sufficiently high tow^ 
ever to conclude that the six principles 
wriced well. 

• lAT meeting activities were viewed as work- 
ing well and using about the right anomt 
of time* 

• CDA's six caipetency and thirteen functionr- 
al areas were rated as very clear and very 
iitportant to the process hy Lar irenbers. 

Qbjggt^^- tt^i^g to investigate tte validity and 
r PHahmt y of the CDA Award Systan^s six conpeten- 
cies and thirteen functional areas. 

TwD questions were used to achieve this objec- 
tive. Answers to the questions provided" the fol- 
lowing: 
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• Prefonn voting ani voting forms record of 
LAT iDonbers denonstrated a degree of fac- 
torial validity, 

• lAT menfcers rated the thirteen functional 
areas order of importance in scmewl-iat a 
consistent manner with the six cotpetency 
areas which are used to categorize the 
functional areas, 

• The results of the factorial studies sug- 
gest that th^e was sane construct val- 
idity and thk CDRC organizing schsna can 
serve as an excellent model for farther 
evaluations ^fb establish the validity of 
the CDAC credential systan. 

• 55% of the local assesstient team relia- 
bility of judgments were rated good or 
excellent, 15% were fair, and 29% poor. 
In general the reliability of the LM? 
msnfcers judgment was good. The voting 
pattern of LflT monbers was reliable for 
the voting farm.. 

Objective four ; to investigate areas which would 
enhance the CDA Credentialing System, One question 
was used to achieve this objective. The answer re- 
vealed that: 
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• Lar menbers felt that at least fifteen 
academic credit iiours should be awarded 
for achieving a CDA credential. 

• The portfolio does require more structure 
in the handbook guidelines. 

o A written test is not necessary before the 
LAT meeting. There was a split response 
among lAT manbers on this question with 
51% disagreeing and 48% agreeing. 



Recanmendations 



The evaluation of tte CDA Credentialing Awacd 
System's first year of operating suggests the 



following recaiTnendc:'d.on s. The Child Development 
Associate Consortium should: 



1. Continue' to operate tte CDA credentialing 
award system as it was designed and func- 
tioned during 1976-76 • 

2. Monitor the enroUee and applications 
files to insure active cardidacy of all 
candidates, 

3. Develop a structured list of items which 
cculd be used in the portfolio and in- 
corporate the list in the process. 

4. Review all forms for clarity and data 
processing. 

5. Increase the number of itans to be rated 
by LAT numbers for each functional area 
to help increase the validity and relia- 
bility of the CDA assesanent system. 

6. Obtain a carmon rating for CDAC Repre- 
sentative on a graqp of candidates. This 
rating should be used to develop a stan- 
dard of judgnent within LAT meetings ani 
the corpitation of reliability coeffi- 
cient. 

7. Secure acadanic credit for the CDA cre- 
dentJal . 

8. Explore the use of a written test designed 
to measure basic infonnation about each 

of the thirteen functional areas. 

9. Inplement an on-going managerial evalua- 
tion system to adjust and continue to 
refine CDA*s credentialing systons. 
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